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ROBUST CONNECTIVITY ANALYSIS FOR MULTI-AGENT SYSTEMS 


D. BOSKOS AND D. V. DIMAROGONAS 


Abstract. In this report we provide a decentralized robust control approach, which guar¬ 
antees that connectivity of a multi-agent network is maintained when certain bounded input 
terms are added to the control strategy. Our main motivation for this framework is to de¬ 
termine abstractions for multi-agent systems under coupled constraints which are further 
exploited for high level plan generation. 


1. Introduction 

Cooperative control of multi-agent systems constitutes a highly active area of research during 
the last two decades. Typical objectives are the consensus problem, which is concerned with 
finding a protocol that achieves convergence to a common value [9j, reference tracking [l] and 
formation control [B]. A common feature in the approach to these problems is the design of 
decentralized control laws in order to achieve a global goal. 

In the case of mobile robot networks with limited sensing and communication ranges, con¬ 
nectivity maintenance plays a fundamental role m- In particular, it is required to constrain 
the control input in such a way that the network topology remains connected during the evo¬ 
lution of the system. For instance, in [B] the rendezvous and formation control problems are 
studied while preserving connectivity, whereas in [3j swarm aggregation is achieved by means 
of a control scheme that guarantees both connectivity and collision avoidance. 

In our approach we provide a control law for each agent comprising of a decentralized feedback 
component and a free input term, which ensures connectivity maintenance, for all possible 
free input signals up to a certain bound of magnitude. The motivation for this approach 
comes from distributed control and coordination of multi-agent systems with locally assigned 
Linear Temporal Logic (LTL) specifications. In particular, by virtue of the invariance and 
robust connectivity maintenance properties, it is possible to define well posed decentralized 
abstractions for the multi-agent system which can be exploited for motion planning. The latter 
problem has been studied in our recent work [2] for the single integrator dynamics case. 

In this work, we design a bounded control law which results in network connectivity of 
the system for all future times provided that the initial relative distances of interconnected 
agents and the free input terms satisfy appropriate bounds. Furthermore, in the case of a 
spherical domain, it is shown that adding an extra repulsive vector field near the boundary of the 
domain can also guarantee invariance of the solutions and simultaneously maintain the robust 
connectivity property. The latter framework enables the construction of finite abstractions for 
the single integrator case. 

The rest of the report is organized as follows. Section 2 introduces basic notation and pre¬ 
liminaries. In Section 3, results on robust connectivity maintenance are provided and explicit 
controllers which establish this property are designed. In Section 4, the corresponding con¬ 
trollers are appropriately modified, in order to additionally guarantee invariance of the solution 
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for the case of a spherical domain. We summarize the results and discuss possible extensions 
in Section 5. 


2. Preliminaries and Notation 

2.1. Notation. We use the notation \x\ for the Euclidean norm of a vector x £ R". For a matrix 
A £ R mx " we use the notation |Gl| := max{|AT| : x £ R”} for the induced Euclidean matrix 
norm and A T for its transpose. For two vectors x, y £ R"(= R" xl ) we denote their inner product 
by (x, y) := x T y. Given a subset S of R”, we denote by cl(S'), int(S') and dS its closure, interior 
and boundary, respectively, where dS := cl(5) \ int(S). For R > 0, we denote by B(R .) the 
closed ball with center 0 £ R n and radius R. Given a vector x = (a; 1 ,..., x n ) £ R" we define the 
component operators ci(x) := x, l = 1,..., n. Likewise, for a vector x = (ari,..., Xn) £ R^ 11 
we define the component operators Ci(x) := {ci{x i),..., ci(xn)) £ R N , l = 1,... ,n. 

Consider a multi-agent system with N agents. For each agent i £ {1,... ,N} := AT we use 
the notation M t for the set of its neighbors and \Mi\ for its cardinality. We also consider an 
ordering of the agent’s neighbors which we denote by j\, ■ ■ ■ & stands for the undirected 

network’s edge set and {i, j} £ £ iff j £ Mi . The network graph Q := {MM) is connected if for 
each i,j £ M there exists a finite sequence G M with i\ = i, ii = j and {ik , ik+ 1 } G £, 

for all fc = 1,..., l — 1. Consider an arbitrary orientation of the network graph Q, which assigns 
to each edge {i,j} G £ precisely one of the ordered pairs (z, j) or (j, i). When selecting the 
pair ( i,j ) we say that z is the tail and j is the head of edge {z, j}. By considering a numbering 
l = 1,..., M of the graph’s edge set we define the N x M incidence matrix D(Q) corresponding 
to the particular orientation as follows: 

{ 1, if vertex k is the head of edge l 

— 1, if vertex k is the tail of edge l 
0, otherwise 

The graph Laplacian L(Q) is the N x N positive semidefinite symmetric matrix L(Q) := D(Q) x 
D{Q) T . If we denote by 1 the vector (1,...,1) G R^, then L(Q)1 = D{Q) T t = 0. Let 
0 = Ai(t/) < \ 2 {G) < ■ ■ ■ < \n{Q) be the ordered eigenvalues of L{Q). Then each corresponding 
set of eigenvectors is orthogonal and \ 2 {G) > 0 iff Q is connected. 

2.2. Problem Statement. We focus on single integrator multi-agent systems with dynamics 

xt = Ui,Xi £ R",z = 1,... ,N (2.1) 

We aim at designing decentralized control laws of the form 

Ui . — ki {Xi , Xj 1 , . . . , Xj |^j ) T Vi {2.2) 

which ensure that appropriate apriori bounds on the initial relative distances of interconnected 
agents guarantee network connectivity for all future times, for all free inputs v t bounded by 
certain constant. In particular, we assume that the network graph is connected as long as 
the maximum distance between two interconnected agents does not exceed a given positive 
constant R. In addition, we make the following connectivity hypothesis for the initial states of 
the agents. 

(ICH) We assume that the agents’ communication graph is initially connected and that 
max{|a;.j(0) — (0)| : {i, j} £ £} < R for certain constant R £ (0, R) 


(2.3) 
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2.3. Potential Functions. We proceed by defining certain mappings which we exploit in 


order to design the control law (2.2) and prove that network connectivity is maintained. Let 
r : [R>o —> IR>o be a continuous function satisfying the following property. 

(P) r(-) is increasing and r(0) > 0. 

Also, consider the integral 


P(p) = ( r(s)sds 1 p G IR > 0 
Jo 


Nn 


For each pair (i, j) e AT x AT with { z, j } E £ we define the potential function Vij : R 
as 

Vij{x) = P(\xi - Xj\),\/x = (xi,.. .,x N ) G R Nn 
Notice that T4,(-) = V)i(-). Furthermore, it can be shown that Fy(-) is continuously differen- 


(2.4) 
t IR>o 

(2.5) 


tiable and that 


d 

—Vijix) = r(\Xi - Xj\)(xi - Xj) T 


( 2 . 6 ) 


where stands for the derivative with respect to the ^-coordinates. 


Remark 2.1. Notice that we are only interested in the values of the mappings r(-) and P(-) in 
the interval [0, R), which stands for the maximum distance that two interconnected agents may 
achieve before losing connectivity. Yet, defining them on the whole positive line provides us 
certain technical flexibilities for the analysis employed in the proof of connectivity maintenance. 

3. Connectivity Analysis 


In the following proposition we provide a control law (2.2) and an upper bound on the magnitude 


of the input terms Vi(-) which guarantee connectivity of the multi-agent network. 


Proposition 3.1. For the multi-agent system (2.1), assume that (ICH) is fulfilled and define 
the control law 

Uj = - r(\xi - Xj\)(xi - Xj) + Vi (3.1) 

jeMi 

for certain continuous r(-) satisfying Property (P). Also, consider a constant 6 > 0 and define 

2^ N(N^T)\D(g) T \ 

A 2 (G ) 2 


I< := 


(3.2) 


where D{Q) is the incidence matrix of the systems’ graph and A 2 {G) the second eigenvalue of 
the graph Laplacian. We assume that the positive constant 5, the maximum initial distance R 
and the function r(-) satisfy the restrictions 


with K as given in (3.21 and 


S < 17 r (0) 2— 7~T) s > R 
K r(s) 


MP(R) < P(R) 


(3.3) 


(3.4) 


where P(-) is given in (2.4), and M = |£| is the cardinality of the system’s graph edge set. 
Then, the system remains connected for all positive times, provided that the input terms Vi(-), 
i = 1,..., N satisfy 


\vi(t)\ < 5,Vt > 0 


( 3 . 5 ) 
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Proof. For the proof we follow parts of the analysis in [6] (see also (HI Section 7.2]). Consider 
the energy function 

N 




i=l jtzNi 


where the mappings Vij, {i,j} £ £ are given in (|2.5|). Then it follows from (2.6) that 


d_ 

dxj 


V{x) = ^2 r ^ Xi ~ ~ x o) 1 


(3.6) 


(3.7) 


jeNi 


Also, in accordance with [5] Section 7.2] we have for l = 1,... ,n that 

ci ^2 r d x i~ x j\)(xi- x j) = L w {x)ci(x) 

VjeM / 


(3.8) 


The weighted Laplacian matrix L w (x ) is given as 

L w (x) = D(g)W{x)D(g) T (3.9) 

where D(Q) is the incidence matrix of the communication graph (see Notation) and 

W(x) := diag{wi(:r),.. ,,w M (x)} := diag{r(|zj - Xj\), { i,j} £ £} (3.10) 

(recall that M = |£|). Then, by evaluating the time derivative of V along the trajectories of 
( |2.1[ )-( [3T| ) and taking into account (3.6), (3.7) and (3.8) we get 


v = ~22°i Cl ^ 


= - y ^Cj(x) T L w (x) (L w (, x)ci(x) - Ci(v)) 

i=i 

n n 

= - ^2ci(x) T L w (x) 2 ci(x) + ^ ci(x) T L w (x)ci(v) 


i=i 


i=i 


< - ci(x) T L w (x) 2 ci(x) 


1=1 


y ^q(x) T L w (x)ci(v) 


i=i 


(3.11) 


We want to provide appropriate bounds for the right hand side of (3.11) which can guarantee 


that the sign of V is negative whenever the maximum distance between two agents exceeds the 


bound R on the maximum initial distance as given in (2.3). First, we provide certain useful 


inequalities between the eigenvalues of the weighted Laplacian L w {x) and the Laplacian matrix 


of the graph L(Q). Notice, that due to ( |3.10[ ), for each * = 1,..., M we have Wi(x) = r{\xk — xg\) 

(3.12) 


for certain {k, £} £ £ and hence, by virtue of Property (P), it holds 


0 < r(0) < wAx) < max rtlxu — xA) 
{k,£}e£ 


From (3.12), it follows that L w (x) has precisely the same properties with those provided for 
L(Q) in the Notation subsection. Furthermore, it holds 

\ 2 {x) > A 2 (£)r(0) 


(3.13) 
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where 0 = Ai(x) < A 2 (x) < ••• < Aat(x) and 0 = Ai(<?) < A 2 (G) < ••• < Xn(G) are the 
eigenvalues of L w (x) and the Laplacian matrix of the graph L(G), respectively. Indeed, in order 


to show (3.13), notice that 


,{x) = D(t/)diag{'uii(x),..., w M {x)}D{G) T 
= -D(£)diag{r(0),..., r(0)}D(G) T 

+ £)(^)diag{u>i(x) - r(0),..., w M (x) - r(0)}D(G) T = r(0)L(G) + B 


where (3.12) implies that B D{G) diag{wi(x) — r(0),..., wm{x) — r(0)}D(G) 1 is positive 


semidefinite. Hence, it holds L w (x ) A r(0)L(G), with >; being the partial order on the set of 
symmetric N x N matrices and thus, we deduce from Corollary 7.7.4(c) in [4J page 495] that 
(|3.13b is fulfilled. 


In the sequel we introduce some additional notation. Let H be the subspace 

H := {x € (R^ 11 :x\ = x^ = ■• ■ = Xjy} 


For a vector x £ R Wn we denote by x its projection to the subspace H, and x 1 - its orthogonal 
complement with respect to that subspace, namely x 1 - := x — x. By taking into account that 
for all y £ H we have D(G) T ci(y) = 0 and hence, due to (3.9), that Ci(y) £ ker(L u 


follows that for every vector x £ IR^" with x = x + x 1 - it holds 

L w {x)ci(x) = 0 => L w (x)ci(x) = L w [x)ci{x + x^) = L w (x)ci(x ± ) 


,{x)), it 


(3.14) 


We also denote by Ax £ IR M " the stack column vector of the vectors Xi — Xj, {i,j} £ £ with the 
edges ordered as in the case of the incidence matrix. It is thus straightforward to check that 
for all x £ 

D(G) T x = Ax (3.15) 


and furthermore, due to (3.10) and ( |3.12 1, that 

\W(x)\ < r(|Ax|oo) 


(3.16) 


where 

| Axjoo := max{|Axi|,i = 1,..., M} (3-17) 

Before proceeding we state the following elementary facts, whose proofs can be found in the 
Appendix. In particular, for the vectors x = (xi,... ,Xn), y = (z/i,..., ?uv) £ R Nn the following 
properties hold. 

Fact I. 

\L w (x)ci{x ± )\ > \ 2 {x)\ci{x ± )\yi = 1,... ,n (3.18) 


Fact II. 


Fact III. 


Fact IV. 


;=1 


Y, < \A\y\ 

| Ax | 


Ix^| > 


V2(JV-1) 

\/2|x ± | > |Ax| ( 


(3.19) 

(3.20) 

(3.21) 


We are now in position to bound the derivative of the energy function V and exploit the result 
in order to prove the desired connectivity maintenance property. We break the subsequent 
proof in two main steps. 
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Step 1: Bound estimation for the rhs of (3.11). 


Bound for the first term in (3.11). By taking into account ( |3.14 1, it follows that 

n n n 

^2ci(x) t L w (x) 2 ci(x) = Y \L w (x)ci(x)\ 2 = Y \L w {x)ci(x ± )\ 2 
1 = 1 1 = 1 1=1 

and by exploiting Fact I and ( 3.13[ ), we get 

n n n 

Y \Lw{x)ci(x J ~)\ 2 > Y A 2 (a;) 2 |ci(^ _L )| 2 > 5Z[A 2 (^)r-(0)] 2 |c i (a;- L )| 2 

1 = 1 1=1 1 = 1 

n 

= [A 2 (£)r(0)] 2 Y H x± )\ 2 = [As(^/)?'(0)] 2 |rr J 
Thus, it follows from ( 3.22[ ) and (3.23) that 

n 

5 ~2ci(x) T L w (x) 2 ci(x ) > [A 2 (£)r(0)] 2 |z J 


(3.22) 


_L |2 


1=1 


_L |2 


(3.23) 


(3.24) 


i=i 


Bound for the second term in (3.11[). For this term, we have from (3.9) and (3.15) that 


Y c i( x ) T L w (x)ci(v) 


i=i 


< Y \ C l( X ) TL w(x) c l(v)\ 

1 = 1 

n 

= Y\ci(x) T D(g)w(x)D(g) T Cl (v)\ 
1=1 
n 

= ^2\ci(Ax) T W (x)D(Q) t ci(v)\ 

i=i 

n 

< Y \ c ^ Ax )\\ w i x )\\ D( ^) T \\ c ^ v )\ 


By taking into account (3.16), we obtain 


Y \ c i( Ax )W w ( x )W D (S) T \\ci(v)\ < Y |Q(Aa;)|r(|Aa;| oo )|D(0) T ||Q(u)| 
1=1 1 = 1 

Also, by exploiting Fact II, we get that 

n 

Y MAz)|r(|A:r| 00 )|Z)(£) T ||c i (y)| 


(3.25) 


(3.26) 


1 = 1 


=r(|Aa;| 00 )|.D(£) T | Y |cz(Ax)||cj(t;)| 


1 = 1 


where 


<r(|Ax| 00 )|U(t/) 7 ||A.t||cz(u)| 
<r(|Ax| 00 )|H(t/)' r ||A.r|v / A|?;| 

:= max{|uj|, * = 1,..., N} 


(3.27) 
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Hence, it follows from (3.25)-(3.27) that 


Ci{x) T L w {x)ci{v) 


;=l 


< V / fV|I?(t/) T | |Ax|r(|Ax| 00 )|i;| 


Thus, we get from (3.11), (3.24) and ( 3.28[ ) that 

V < -[A 2 (£)r(0)] 2 |ar L | 2 + VN\D(Q) 7 ||Aa;|r(|Aa:| 0O )|i;| 


(3.28) 


and by exploiting Facts III and IV, that 

V < -[A 2 (0)r(O)] 2 ^=^=|A.T|-^|Ax| oo + v / iV|£>(0) T ||Ax|r(|Aa;| oo )|i;| oo 

= |Aa;| (- 27 l_ T [A 2 (g)r(0)] 2 |Aa:| oo + v / A|^(0) r |r(|Ax| oo )|n| oo ) 


By using the notation |Aa"|oo := s, in order to guarantee that the above rhs is negative for 
s > R, it should hold 


- X 2 (S ) 2 r(0)2g + y]v| J D(S) T |r(s)M 00 < o y s >R 

2 V ( N ~ 1) 

2\/ N(N — 1)\D(Q) t \ 


A 2 (S) 2 


< r(0) 2 ^—,Vs > R 
r(s) 


or equivalently 


|v|oo < 4 r (°) 2 -TT> Vs > & 
A r(s) 


(3.29) 


with I\ as given in (3.2). Hence, we have shown that for v satisfying (3.29) the following 
implication holds 

lA/oo > R => V < 0 (3.30) 


Step 2: Proof of connectivity. 


By assuming that conditions (3.5), (3.3) and (3.41 in the statement of the proposition are 
fulfilled and recalling that according to (ICH) ( |2.3| ) holds, we can show that the system will 
remain connected for all future times. Indeed, let x(-) be the solution of the closed loop system 
with initial condition satisfying ( |2.3[ ), defined on the maximal right interval [0, T max ). 
We claim that the system remains connected on [0,T max ), namely, that max{|x,;(f) — Xj(t)\ : 
{i,j} € £} < R for all t £ [0,T max ), which by boundedness of the dynamics on the set 
T := {x £ IR^" : |xj — Xj\ < R,V{i,j} £ £} implies that T max = oo. In order to prove the 
last assertion, assume on the contrary that T max < oo. Then, by taking into account that x(t) 
remains in J- for all t £ [0, T max ) and that the dynamics are bounded on J -, it follows that x(t) 
remains in a compact subset of IR^” for all t £ [0, T max ) and hence, that it can be extended, 
contradicting maximality of [0,T max ). We proceed with the proof of connectivity. First, notice 
that 


V(*(0)) < -P(R) 


(3.31) 
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Indeed, by exploiting (2.3) and (|3.4[) we get that 


mo))4EE ? (w°)-^°)i) 

i= 1 j€.Afi 
N 

<JEE p ( p ) = ^ 


N 


i =1 j€J\fi 

In order to prove our claim, it suffices to show that 

1 


V(x(t)) < -P(i?),Vf £ [0,T max ) 


(3.32) 


(3.33) 


because if |.T,;(f) — Xj(t)\ > R for certain t £ [0, T max ) and {i, j} € £ , then V(x(t)) > \P(\xi(t) — 
Xj{t) |) > ^P(R). We prove (3.33) by contradiction. Indeed, suppose on the contrary that there 
exists T £ (0,T max ) (due to (3.31|) such that 


and define 


V(x(T)) > ±P(R) 


:= min{t £ [0,T] : V(x(t)) > \P(R)M G {t,T]} 


(3.34) 

(3.35) 


which due to (3.34) and continuity of V{x{-)) is well defined. Then it follows from (3.31) and 
(3.35) that 

V{x{t)) = l -P(R),V{x{i)) > ^-P(R),\/t G (r, T) (3.36) 


hence, there exists r G (r, T) such that 


V(*(f)) = > 0 

1 — T 


On the other hand, due to (3.36), it holds 


1 


V{x{?)) > -P(R) 

which implies that there exists {i,j} G £ with 

I Xi(f) - Xj( f)| > R 


(3.37) 


(3.38) 


(3.39) 


Indeed, if (3.39) does not hold, then we can show as in (3.32) that V{x{f)) < \P(R) which 
contradicts (3.381. Notice that by virtue of (3.5) and (3.3), (3.29) is fulfilled. Hence, we get from 
(3.39) that lAi^loo > R and thus from (3.30) it follows that V(x(?)) < 0, which contradicts 
(3.37). We conclude that (3.33) holds and the proof is complete. □ 


In the following corollary, we apply the result of Proposition 3.1 in order to provide two 
explicit feedback laws of the form (3.1), a linear and a nonlinear one and compare their perfor¬ 
mance in the subsequent remark. 


Corollary 3.2. For the multi agent system (2.1), assume that (ICH) is fulfilled and consider 
the control law (2.2) as given by (3.1). By imposing the additional requirement rifS) = r(R) = 1 
and defining 

R 


6 := 


K 


(3.40) 
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with R and K as given in (2.3) and (3.2), respectively, the system remains connected for all 


positive times, provided that the function r(-) and the constant R are selected as in the following 
two cases (L) and (NL) (providing a linear and a nonlinear feedback, respectively). 

Case (L). We select 

r(s) := 1, s > 0 


and 


R < —=R 
~ s/M 


(3.41) 

(3.42) 


where M is the cardinality of the system’s graph edge set. 
Case (NL). We select 

l, s e [o, R] 
r (s) := ^ s£ (R,R} 
§, se{R,oo) 


and 


R< 


3M- 1 


R 


(3.43) 


(3.44) 


Proof. For the proof we apply the result of Proposition (3.1). In particular, it suffices to show 


that for both cases (L) and (NL) the selection of the function r(-) and the initial maximum 


distance R satisfy (|3.3|) and (|3.4[), with d as given by (3.40). 


Case (L). Indeed, it follows from (3.40) and (3.41) that 

r R 1 R . 1 s 

K I< r(s) y 1 ~ K r(s) 


r(0) 2 ,Vs > R 


hence, (3.3) is fulfilled. Furthermore, it follows from ( |3.41 ) and (2.4) that 
MP(R ) < P{R) < 


pR nR 

M / r(s)sds < / r(s)sds 

Jo Jo 

,, r * J f R , , r R 2 R 2 

M / sds < / sds ^==> M— < — 

Jo J R 2 2 


R < 


\j~M 


R 


Case (NL). Also in this case, it follows from (3.40) and (3.43) that 


5 =ff = ^ Sf (°) 2 ^ 7r4 r ( 0 ) 2 = dFTA r (°) 2 ’ Vs e (^’^1 
K K s K A r(s) 


R R s 2 
KR r{0) 

R R 


and that 
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hence, (3.3) is again fulfilled. In addition, it follows from (3.43) and (2.4) that 


MP(R) < P{R) 


pR pR 

M / r(s)sds < / r(s)sds 

Jo Jo 

r R ,-R 

M 

/o' Jo ' ' Jr 

pR -i pR 


pit pit pit 

/ r(s)sds < / r(s)sds + / r(s)sds 

Jo Jo Jr 

r R i r R 

(M — 1) / sds < — / s 2 ds 

Jo R Jr 


ir 

M-l-o 1 1 ~o 

—-— R 3 < -R 3 - -R 3 
2 “ 3 3 


<=► (Af- 1)— < i -s 3 
v ’ 2 - r 3 

3M -3-o 2~ s 1 o 

——R 3 + -i? 3 < -i? 3 
6 6 3 


3M- 1 


I? 3 < I? 3 


i?< 


3M- 1 


I? 


□ 


Remark 3.3. At this point we derive the advantage of using the nonlinear controller over 
the linear one by comparing the ratio of the maximal initial relative distance that maintains 
connectivity for these two cases. In both cases we have the same bound on the free input terms 
and the same feedback law up to some distance between neighboring agents, which allows us 
to compare their performance under the criterion of maximizing the largest initial distance 
between two interconnected agents. In particular, this ratio, which depends on the number of 
edges in the systems’ graph, is given by 


Rat(M) := 



(3.45) 


It is evident from the plot of Rat(M) in Figure 1 that it is a decreasing function of M with 
values less than 1 for M > 1. The latter property follows quite intuitively if we take a look at 
Figure 2. Indeed, as sown in the proof of Proposition (3.1), both the maximal initial distance 
Rl for the linear and Rnl for the nonlinear case are expressed by virtue of (3.41 as the solutions 
of the equation P ^ R p^ = mGr- Figm' e 2, both the quotient of the area inside the orange 
frame over the area in the red frame and the quotient of the violet area over the blue area are 
the same and equal to - = -pfoj-, with P(-) as defined for both the cases (L) and (NL) 

through (2.41, (3.41) and (3.43). It is thus straightforward that the quotient of Rj. over Rnl, 
namely Rat(M) should be less than 1. Yet, we also provide a formal proof of this argument by 
studying the monotonicity of Rat(-). 

For convenience we consider the 6-th power of Rat(M ), namely the function 



(3M — l) 2 


Rat 6 (M) : 


2 3 M 3 
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Hence, by evaluating the derivative of Rat 6 (M ) we obtain 

d (3 M - l) 2 2(3 M - 1)3 • 2 3 M 3 - (3 M - 1) 2 2 3 3 M 2 


Rat 6 (M ) = 
dM y ’ dM 


2 3 M 3 2 6 M6 

3 • 2 3 M 2 (3M - 1)[2M - (3 M - 1)] _ 3 3 M - 1 

2 6 M e “ 23 ' M 4 


(1 - M) < 0, for M > 1 



FIGURE 1. This figure shows the ratio 3 for the number of edges 

ranging from 2 to 150 



FIGURE 2. Rl and Rnl and norms of the respective feedback control laws for M = 12 
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4. Invariance Analysis 


In what follows, we assume that the agents’ initial states belong to a given domain D C IR n . 
In order to simplify the subsequent analysis, we assume that D = int (13(91)), namely the 
interior of the ball with center 0 £ IR n and radius 91 > 0. We aim at designing an appropriate 


modification of the feedback law (3.1l which guarantees that the trajectories of the agents 
remain in D for all future times. 

For each e £ (0, 93), let N e be the region with distance e from the boundary of dD towards the 
interior of D , namely 

N e := {x £ R” : R - e < \x\ < R} (4.1) 


and 


D e :=D\ N e 


(4.2) 


We proceed by defining a repulsive from the boundary of D vector field, which when added 


to the dynamics of each agent in (3.1), will ensure the desired invariance of the closed loop 


system and simultaneously guarantee the same robust connectivity result established above. 
Let h : [0,1] —► [0,1] be a Lipschitz continuous function that satisfies 


h( 0) = 0; h( 1) = 1; h(-) strictly increasing 


We define the vector field g : D 


IR 71 


as 


[ 0, if x £ D e 


(4.3) 


(4.4) 


with h(-) as given above and appropriate positive constants c, 6 which serve as design parame¬ 


ters. Then, it follows from (4.3), (4.4) and the Lipschitz property for h(-) that the vector field 
<?(•) is Lipschitz continuous on D. 

Having defined the mappings for the extra term in the dynamics of the modified controller 
which will guarantee the desired invariance property, we now state our main result. 


Proposition 4.1. For the multi-agent system (2.1), assume that D = int(13(9l)), for certain 


91 > 0 and that (ICH) is fulfilled. Furthermore, let e £ (0,91), N e and D e as defined by (4.1) 
and (4.2), respectively and assume that the initial states of all agents lie in D e . Then, there 
exists a control law \2.2\ (with free inputs v,) which guarantees both connectivity and invariance 
of D for the solution of the system for all future times and is defined as 


E 


= 9{xi) - E r(\xi - xj\)(xi - Xj) + ' 


(4.5) 


with g(-) given in (4.4) and certain r(-) satisfying Property (P). We choose the same positive 
constant 5 in both (3.5) and (4.4) and select the constant c in (|4.4[) greater that 1. Then the 


connectivity-invariance result is valid provided that the parameters S, R and the function r(-) 
satisfy the restrictions (3.3), (3.4) and the input terms i’i(-), i = 1, ... ,1V satisfy (3.5). 


Proof. We break the proof in two steps. In the first step, we show that as long as the invariance 


assumption is satisfied, namely, the solution of the closed loop system (2.1)-(4.51 is defined and 


remains in D , network connectivity is maintained. In the second step, we show that for all 
times where the solution is defined, it remains inside a compact subset of D , which implies 
that the solution is defined and remains in D for all future times, thus providing the desired 
invariance property. 
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Step 1: Proof of network connectivity. 

The proof of this step is based on an appropriate modification of the corresponding proof 
of Proposition 3.1 In particular, we exploit the energy function V as given by (3.6) and show 
that when |Ax|oo > R, namely, when the maximum distance between two agents exceeds R 
then its derivative along the solutions of the closed loop system is negative. Thus by using the 
same arguments with those in proof of Proposition |3.1| we can deduce that the system remains 


connected. Indeed, by evaluating the derivative of V along the solutions of ( 2 . 1 )-(4.5) we obtain 

N 




2 — 1 
N 


dxi 


X)Xi 


= Y g a £ V ( x )9( x i) - ^ci{x) T L w (x) 2 ci(x) + ^ci(x) t L w{X Mv) 


i =1 

N 


( = 1 


< Y faT V (a:)g(xi) - Y Ci(x) T L w (x) 2 ci{x) + 


i=i 


y ^ci(x) t L w (x)ci(v) 


i=i 


(4.6) 


By taking into account (3.11) and using precisely the same arguments with those in proof of 
Steps 1 and 2 of Proposition 3.1 it suffices to show that the first term of inequality (4.6), which 
by virtue of (3.7) is equal to 

N 


d 


N 


J2far V ( X ) 9 ( X i) = YY r (\ X i- X j\)(( X i- X i)’9( x i)) 


i=1 


*=i jetfi 


is nonpositive for all x € D. Given the partition D e , N e of D, we consider for each agent i £ Af 
the partition N ®", of its neighbors’ set, corresponding to its neighbors that belong to D e 
and N e , respectively. Also, we denote by £ Ne the set of edges {i,j} with both Xi,Xj £ N E . 
Then, by taking into account that due to (4.4), g(xi) = 0 for a \ £ D ei it follows that 

N 

Y Y r (l X i-Xj\){{x.i- Xj),g{ x i)) 

i —l j&Mi 

Y Y r ^ Xi ~ x o\)^ Xi ~ x i)'9{ Xi )) 

{i£AT:xi£N e } j&Afi 

= Y Y r {\ x i- x j\){{ x i- x i)i9{xi)) 

{i£AT:xi£N e } jeAC 0 'U7V” e 

= Y Y r (\ X i- X o\)(( X i- X j)’9{Xi)) 

{i£Af:xieN e } jfzj^Ve 

+ Y r (\ x i- x M(( x i- x o),9{ x i)) + (( x j- x i),9( x j))} (4-7) 

{i,j}es N e 


In order to prove that both terms in (4.7) are less than or equal to zero and hence derive our 
desired result on the sign of V, we exploit the following facts. 

Fact V. Consider the vectors a, /?, 7 £ IR n with the following properties: 

I ad = 1, 1/31 = 1 


(4.8) 
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(a, 7 ) > 0 , </3, 7 ) < 0 

(4.9) 

Then for every quadruple A a , 

A/3,Ata,M/3 € R >o satisfying 



Aa A A^, jL a ' 

(4.10) 

it holds 

({VaOt- npf}),5) > 0 

(4.11) 

where 

5 := A a a + 7 - A^/3 

(4.12) 


We provide the proof of Fact V in the Appendix. 


Fact VI. For any x, x £ N E with x = Ax, A > 0 and y £ cl (D e ) it holds 

((x-y),x) > 0 

The proof of Fact VI is based on the elementary properties y £ cl (D s ) => \y\ < 91 — e and 
x, x £ N e =>■ 91 — e < \x\ and 91 — e < |x|. Hence we have that 

{{x-y),x) > |x||i| - \x\\y\ > 0 


We are now in position to show that both terms in the right hand side of (4.71 are nonpositive, 
which according to our previous discussion establishes the desired connectivity maintenance 
result. 


Proof of the fact that the first term in (4.71 is nonpositive. For each i,j in the first 
term in (4.71 we get by applying Fact VI with x,x = Xi £ N e and y = Xj £ D e that 


r(\xi - Xj\)({xi - Xj),g(xi)) 
—cdh ( E+l ^ | - gl ) 


=r( Xi - Xi 


( Xj^jXi') ^ 0 


and hence that the first term is nonpositive. 

Proof of the fact that the second term in (4.71 is nonpositive. We exploit Fact V in 
order to prove that for each {i,j} £ £ Ne the quantity 


{{xi - Xj),g(xi)) + ((Xj - Xi),g(xj)) 


(4.13) 


in the second term of ( |4.7| ) is nonpositive as well. Notice that both Xi,Xj £ N e and without 
loss of generality we may assume that 


\Xi\ > \Xj\ 

namely, that Xi is farther from the boundary of D e than Xj. Then by setting 

Xi 


(4.14) 


a :=t 


Xi 


\xA 


7 :=Xi - Xj 


(4.15) 

(4.16) 

(4.17) 








ROBUST CONNECTIVITY ANALYSIS FOR MULTI-AGENT SYSTEMS 


15 


with 


Xi :=Xi - (\xi\ + e - 91)—^ 
\Xi\ 


x j -= x i - IFj 


-e-StjPi 


and 


A a 

A/3 

M/3 


= \Xi\ +£-d\ 

= \Xj\ + E — d\ 

=c5h (|xi| + e — 91) 
=cSh (| | + £ — 91) 


(4.18) 

(4.19) 


(4.20) 

(4.21) 

(4.22) 

(4.23) 


it follows from (4.15) and (4.16) that 


\*\ = m = i 

and from Q, flOI) ), ( |420| , ( |472l| ), fO?] ) and ( fT23] ) that 

Ack A \jj A 0, /J, a ^ V 0 


Furthermore, we get from (4.18) and (4.19) that \xi\ = \xj\ = 91 — e =>• Xi,Xj £ dD e . Thus, it 
follows from (4.15), (4.16), (4.17) and application of Fact VI with x = Xi, x = Xi and y = Xj 
that 

(a, 7 ) > 0 

and similarly that 

(A 7 ) < 0 

It follows that all requirements of Fact V are fulfilled. Furthermore, by taking into account 


(4.15)-(4.21), we get that 


S = A a a + 7 — A^/3 = Xi — . 


(4.24) 


Thus we establish by virtue of (4.41, (4.11), (4.12), (4.15), (4.16), (4.22 1 , (4.23) and (4.24) that 


({HaU - M/3/?),£) = ~((g( x i) ~ g(Xj)), (,Xi - Xj)) > 0 

{(Xi - Xj),g(xi)) + {{Xj - Xi), g(xj)) < 0 


as desired. 


Step 2: Proof of forward invariance of D with respect to the solution of (2.1)-(4.5). 


We proceed by proving that the control law (4.5) also guarantees the desired invariance 


property for the solutions of system (2.1)-(4.5), provided that the input terms Vi(-), i = 1 ,... ,N 


satisfy (3.5). Let [0,T max ) be the maximal forward interval for which the solution x(-) of (2.1)- 
(4.5) with :r(0) £ D e exists and remains inside D. We claim that for all t £ [0,T max ) the 
solution remains inside cl(Z?^i ) with 


c = 


h ~H l c ) 


h ( = -; c > 1 

c c 


(4.25) 


and where c > 1 and h(-) are given in the statement of the proposition and (4.3), respectively. 
Then, it also follows from the fact that x(t) remains in the compact subset c\(Dc-i £ ) of D for 
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all t £ [0, T max ), that T max = oo, which provides the desired result. In order to prove our claim, 
we need to define certain auxiliary mappings. For each i £ TV } we define the functions 




e + \xi(t)\ — D\, if Xi{t) £ N e 
0, if Xi{t) £ D e 


t £ [0, T max ) 


(4.26) 


and 

m(t) := max{wj(t) : i = 1,..., N}, t £ [0, T max ) (4.27) 

where rrii(t) denotes the distance of agent i from D e at time t and m[t) is the maximum over 

those distances for all agents. Hence, for all t £ [0, T max ) and all e £ (0, e] we have the following 

equivalences 

Xi{t) £ N g <*=> nrii(t) £ [e -e,e) (4.28) 

Xi(t) £ dD g <*=> m,i(t) = e — e (4.29) 

and for alH = 1,..., N that 

Xi{t) £ cl(Dg), Vi = 1,..., N m(t) £ [ 0,e —e] (4.30) 


Notice that the functions TOj(-), i = 1,..., N and m(-) are continuous and due to our hypothesis 
that x(0) £ D e , satisfy 

m(0) = 0 (4.31) 

We claim that 


m(t) < -,\/t£ [0,T max ) 


(4.32) 


with c as given in (4.25). Indeed, suppose on the contrary that there exists T £ (0,T max ) such 
that 

(4.33) 


and define 


m(T) = i £ ^|,e^ 

t := min jf £ [0,T] : m(t) > ^ ,Vt G [f, T]| 


(4.34) 


Then it follows from (4.33) that r is well defined and from (4.31), (4.34) and the continuity of 
to(-) that 

m ( T ) = \ (e + |) ( 4 -35) 

and that there exists a sequence (f„)j/giM with 

t v \ t and m(ty) > ^ | j , W £ IN (4.36) 

From (4.27), ( |4.35 ), (4.36) and the infinite pigeonhole principle we deduce that there exists 
i £ { 1,..., N} and a subsequence (t yfc )fceN of (f;,)„£iM such that 


mi{t Vh ) >-(e+^) ,Vfc £ N;TOi(r) = - + 0 


(4.37) 


Thus, it follows by virtue of (4.28) and (4.29) that 


iV't'k ) 


e N e _t( i+i yVk £ N;®i(r) £ dD e _ 


(4.38) 
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Set W(x) = \x\ 2 and notice that due to ( 4.38| ) it holds \xi(t Vk )\ > |xi(r)|, V/c G IN. The latter 
implies that 


— W(xi(t)) 

On the other hand, we have that 
d . 


= lim W(xj(U k )) - W(xj(T )) > Q 
k—too ti/ k — T 


(4.39) 


dt 


W(xi(t )) 


= VW(Xi(T))Xi(T) 


= Xi(T) q 


g{xi{r)) + Vi(r) - r (\ x i( T ) - x j( T )\)( x i( T ) - Xj (t)) 

jeJdi 


(4.40) 


By taking into account (4.331 and (4.38) we get that 

1 


(t) | = 93 - £ + - ^£ + |) > 93 - £ + 


£ C — 1 

- = 93-£ 

c c 


and hence from (4.3), (4.4) and (4.251 that 


\g(xi(r))\ > c5h 


£ + 93- £#£-93 


= cSh 1 — 


c — 1 


= cSh I - ) = 6 


Also, due to (4.4) it holds 

Xi(r) = - ag(xi(r)) 

for certain a > 0. Then we get from ( |4.41 1, (4.42) and the fact that |vj(r)| < S that 
Xz(r) T [g{xi(T))+Vi{r)} < a;,;(r) T g{xi{r)) + |xi(r)|| + (t)| 

= -ki(#ll5(®i(T))l + M r )l#(' r )l 

= ~\xi(T)\(\g(xi(T))\ - | u »( t )|) < 0 


(4.41) 

(4.42) 


(4.43) 


Furthermore, we have from (4.35) and (4.30) that Xj(r) G c\(D s _ i (g + s)) f° r all 3 S A/) and 
from (4.38) that a# t) G N £ _is i+!i y Thus, it follows from Fact VI that 


i( T ) T (xi(r) - Xj{r)) = (Xi(r ), (x»(r) - x 0 {t))) < 0 


(4.44) 


From (4.43) and (4.44), we obtain that (4.40) is negative, which contradicts (4.39). Hence, 
(4.32) holds, which implies that x(t) remains in the compact subset cK/D<■--•. ) of D for all 
t G [0, T max ). Thus, T max = oo and we conclude that the solution x(-) of the system remains in 
D for all t > 0. □ 


5. Conclusions 

We have provided a distributed control scheme which guarantees connectivity of a multi¬ 
agent network governed by single integrator dynamics. The corresponding control law is robust 
with respect to additional free input terms which can further be exploited for motion planning. 
For the case of a spherical domain, adding a repulsive vector field near the boundary ensures 
that the agents remain inside the domain for all future times. The latter framework is motivated 
by the fact that it allows us to abstract the behaviour of the system through a finite transition 
system and exploit formal method tools for high level planning. 
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Further research directions include the generalization of the invariance result of Section [4] for 
the case where the domain is convex and has smooth boundary and the improvement of the 
bound on the free input terms, by allowing the bound to be state dependent. 


6. Appendix 

In the Appendix, we provide the proofs of Facts I, II, III and IV which were used in proof 
of Proposition |3.1| and of Fact V, in proof of Proposition |4.1| For convenience we state the 
elementary inequality 

2 (H 2 + \z\ 2 ) > \w- z\ 2 ,\/w,z € R n (6.1) 

Proof of Fact I. Let {e-k}k=i,...,N be an orthonormal basis of eigenvectors corresponding to 
the ordered eigenvalues of L w (x). Then, for each l = 1,..., n we have that 

N 

ci(x ) — ^ IE [R, k — 2, ..., N 

k =2 


and hence, that 


N \ 2 


R 


0^)1 = 


Thus, we get that 


I L w {pc)ci{x )| — 


N 




k—2 
/ N 


\k=2 


N 


y^jj, k ^k(x)e k 


k=2 


N \ 2 


= '52{l*kXk(x)) 2 > A 2 {x) = / ^ 2 ( a ')l Ci ( a '" L )l 


\k=2 


\.k=2 


1=1 


which establishes (3.18). 

Proof of Fact II. By taking into account the Cauchy Schwartz inequality we obtain 

n / n \ 2 / n \ 2 

5Xx)|h(2/)| < (^|q0t)| 2 J f l c *(y)| 2 J 

( n N \ h / n N \ ^ 

(EZ c ^) 2 ) 

1=1 i= 1 / \Z=1 i=l / 

( N n \ i / N n \ ^ 

J^^CliXi) 2 ] ( c i(yi) 2 J 

2=1 J = 1 / \i=l /=1 / 

/ N \h/N \ ^ 

= (Hl ;ri l 2 ) (5ZN 2 ) =\ x \\y\ 


K i=l 


and hence (3.19) holds. 
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Proof of Fact III. By the definition of x ± and x , it follows that there exists x £ IR n such that 
x — x 1 - = x = (®,..., x) £ R Nn . Hence, we have that 

\x^\ = \x-x\ = \(x 1 ,...,x N ) - (x, = |(a?i -x, ...,x N - x)\ 


N 


= H l*i - : 


^2=1 
( N 


\/2(JV - 1) |® x | = [Y, 2{N - 1)1®* - . 


^ 2—1 


Y 2(|®* — x\ 2 + \xj — x\ 2 ) 
Ai,j}e£(K(AT)) 


where £{K(N)) stands for the edge set of the complete graph with vertex set J\f. Then, it 
follows from (16.Ill that 


Y 2(|a:j — x\ 2 + \xj — x\ 2 ) I > Y \xi~Xj | 


Ai,j}e£{K{M)) 


Ai,i}e£(K( AO) 


> 


'y ' i x i x j i 


= l A z| 


which provides the desired result. 


Proof of Fact IV. Notice that (3.21 1 is equivalently written as 


v 2 |®" L | > max I®* —a :,-1 
{i,j }e£ 3 


2 |® _l | > max I®* — ®,| 2 
' H,i }e£ 1 31 


N 


2 _ 5 i 2 - 


{Ci}e£ 


with ® G IR" as in proof of Fact III. Let {i, j} £ £ such that \x~ t — ®-.| = max^j jjgf |®* — Xj\. 
Then, by taking into account (6.1) we have 


2 \ Xi ~ f l 2 ^) - 2 (K _ 5 I 2 +1^' _ 5 I 2 ) ^ K - 


x-j\ 2 = max |®j — ®,-| 2 


{i,j }e£ 


and thus (3.21) is fulfilled. 

Proof of Fact V. By taking into account (4.8 )-( 4T0| ) and ( |4. 12 I we evaluate 
((/x a o - upfi), 6) = ((n a a - upfi), (\ a a - Xpfi) + 7 ) 

= ((/r tt a- upfi), (\ a a- Xpfi)) + ix a (a, 7) - 
> {(ix a a - /i/3/?), (A a a - A/3/3)) 

/i Q X a \a\- (/ 1 qA /3 T /i/ 3 A q )( o, /3) T fip A/ 3 1/31 

A /i Q A Q |o|“ (/iaA/3 4“ /i/3 Aq. ) | o? 11 /31 -)- /i/3A/3|/3| 

/i Q A a /iQ,A^3 /i-/3 Aq. T /i/3A/3 

— /ia (Aa A/3) /i/3(Aa A/3) — (/la Ai/ 3 ) ( Aq. A/3) A 0 


and hence (4.11) holds. 
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